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(54) Advanced applications for 3-D autoscanning lidar system 



(57) Methods for operating a laser scanning system 
are disclosed. The laser scanning system can be used 
in construction projects to generate a field survey. An 
architect or engineer can use the field survey to create 
construction drawings. In addition, relevant points from 
the construction drawings can be identified at the con- 
struction site with the scanning system. The laser scan- 
ning system can additionally be used to identifying ob- 
jects within the site and to build databases that have 
relevant information about the objects. 
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Description 

[0001 ] This application claims priority from provisional 
application 60/1 43,695 filed on July 1 4, 1 999 by Ben Ka- 
cyra and Jerry Dimsdale for Advanced Applications for 
3-D Autoscanning Lidar System. 

BACKGROUND OF THE INVENTION 

1. Field of the Invention. 

[0002] The present invention relates to a laser scan- 
ning system and, more particularly, to a method for op- 
erating a 3-D autoscanning LIDAR system. 

2. Description of the Related Art. 

[0003] It is often desirable to have computer models 
of large physical structures, such as a petroleum refin- 
ery. Computer models facilitate an understanding of the 
structure that is beneficial in a number of ways. One 
technique for constructing these computer models is to 
use a laser scanning system such as the system de- 
scribed in U.S. Patent Application No. 09/177,913. (The 
'913 application is a continuation of 08/638,961 which, 
in turn, is a continuation of International Application No. 
PCT/US97/06793. Application '06793 has International 
Publication No. WO 97/40342.) 

[0004] The '913 system includes a combination laser 
scanner and PC software system that measures, visu- 
alizes and models large structures and sites with high 
speed, high accuracy and over a large range. In use, 
the device is oriented towards the scene and the user 
selects the desired measurement area and measure- 
ment point spacing. A detailed 3-D geometry of exposed 
surfaces is remotely captured in the form of a dense, 
accurate, three dimensional point cloud. 
[0005] The '913 system includes a passively Q- 
switched pulsed laser. The laser beam is scanned over 
the target using computer-controlled galvo scanning 
mirrors. The system includes a video monitor for cap- 
turing the scene and displaying it on a computer such 
as a laptop. Using this video image, the operator can 
select the area to be scanned by the laser. 
[0006] The galvo mirrors direct the laser through re- 
peated vertical scans, moving over horizontally after 
each vertical scan. By accurately monitoring the time of 
flight of each laser pulse out from the device and back 
into the device, exact positional information of the target 
can be calculated. 

[0007] Each measured point has associated with its 
3-D information in the point cloud. The system software 
can display the point cloud to the user. As discussed 
herein in greater detail, the point cloud can be used to 
directly carry out a number of procedures. In addition, 
the system can process the point clouds into wire mesh- 
es, 3-D models and 2-D drawings for export to popular 
computer-aided design (CAD) rendering or other soft- 



ware. 

[0008] In the '913 application, some basic real-world 
examples were discussed. For example, it was suggest- 
ed that the system could be used to create a three di- 
5 mensional image of a construction site or a building. 
This 3-D data could be viewed directly or used to gen- 
erate CAD drawings. 

[0009] Because of the high speed and accuracy of the 
system, further applications have been developed 

10 which can greatly benefit from these features. This pat- 
ent application is intended to describe some of these 
concepts. 

SUMMARY OF THE INVENTION 

15 

[0010] The present invention provides a method for 
operating a laser scanner. The method includes the step 
of scanning a site with the laser scanner to create a field 
survey that has a number of scan points. The method 
20 also includes the step of creating a drawing of a struc- 
ture that has a number of defined points that are posi- 
tionally related to the scan points in the field survey. 
[0011] The method further includes the step of res- 
canning the site with the laser scanner to obtain rescan 
25 data. The rescan data corresponds to a number of the 
scan points. The method additionally includes the step 
of registering the rescan data with the defined points 
from the drawing to form registered data. The method 
also includes the steps of identifying a location of inter- 
ne est from the registered data, and illuminating a location 
at the site with a laser beam from the laser scanner that 
corresponds with the location of interest. 
[001 2] A better understanding of the features and ad- 
vantages of the present invention will be obtained by ref- 
35 erence to the following detailed description and accom- 
panying drawings that set forth an illustrative embodi- 
ment in which the principles of the invention are utilized. 
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BRIEF DESCRIPTION OF THE DRAWINGS 

40 

[0013] 

FIG. 1 is a flow chart 100 illustrating an example of 
the operation of a laser scanner to facilitate con- 
45 struction planning and monitoring in accordance 
with the present invention. 

FIG. 2 is a flow chart 200 illustrating an example of 
the operation of a laser scanner with constructed 
parts in accordance with the present invention. 
50 FIG. 3 is a flow chart 300 illustrating an example of 
the operation of a laser scanner for a constructabil- 
ity analysis in accordance with the present inven- 
tion. 

FIG. 4 is a flow chart 400 illustrating an example of 
55 the operation of a laser scanner for controlling an 
earth mover in accordance with the present inven- 
tion. 

FIG. 5 is a flow chart 500 illustrating an example of 
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the operation of a laser scanner for facilitating ma- 
terial handling in accordance with the present in- 
vention. 

FIG. 6 is a flow chart 600 illustrating an example of 

the operation of a laser scanner for replicating ex- 
isting parts in accordance with the present inven- 
tion. 

FIG. 7 is a flow chart 700 illustrating an example of 
the operation of a laser scanner for creating repos- 
itories of information about various objects in ac- 
cordance with the present invention. 

DETAILED DESCRIPTION 

[0014] The assignee of the subject application has de- 
veloped an integrated 3-D imaging and modeling sys- 
tem which is marketed under the trademark CYRAX. 
This system is described in detail in PCT application WO 
97/40342, published October 30, 1997, the disclosure 
of which is incorporated herein by reference. 
[001 5] The Cyrax device or any similar device (i.e. any 
remote means of collecting a cloud of points) can be 
used at many stages of the construction process of a 
facility. FIG. 1 shows a flow chart 1 00 that illustrates an 
example of the operation of a laser scanner to facilitate 
construction planning and monitoring in accordance 
with the present invention. 

[0016] As shown instep 11 Oof FIG. 1, once a site has 
been selected, the site is scanned with the laser scanner 
to create a field survey. This information can then be 
provided to the architect or engineer who, in step 112, 
plans and designs the structure based on the highly ac- 
curate data provided by the scanner. 
[0017] The architect or engineer then creates a de- 
sign drawing of the structure that has a number of de- 
fined points that are positionally related to the scan 
points in the field survey. After the architect or engineer 
has completed the design drawings for the structure, the 
drawings can be downloaded into the system using well 
known methods of CAD exchange. On an object by ob- 
ject basis, the geometric information can be converted 
from one format to another. 

[0018] In a very important aspect of this disclosure, 
the system can help lay out the key features in the ar- 
chitect's design drawings on the actual construction site. 
To carry out this procedure, the system would be 
brought back to the site. As shown in step 114, the site 
is rescanned with the scanner to obtain rescan data that 
corresponds to a number of the scan points. The site 
can be completely rescanned or partially rescanned. In 
addition, specific targets with known geometric relation- 
ships to the new design can also be rescanned. Next, 
as shown in step 116, the rescan data, which includes 
the cloud of points or the specific targets, is then regis- 
tered with the architect's plans stored in the system soft- 
ware to form registered data. 

[0019] The process of registering the cloud of points 
or targets with the plans is well known in the art. Fea- 



tures in the scan data, whether they be surveying mon- 
uments, targets, or simple features in a scene (such as 
the vertex at a corner) are matched with known locations 
(in the drawing coordinate system) to determine the re- 

5 quired transformation between the rescanned data and 
the drawing data. The resulting transformation can then 
be used to map drawing locations to real world locations 
that can be identified by the scanner. 
[0020] As shown in step 1 1 8, after registration is com- 

10 plete, locations of interest are identified from the regis- 
tered data. For example, an operator can highlight a lo- 
cation of interest, such as a corner of a wall on the plans, 
on the display screen of the scanner. Next, as shown in 
step 120, the system can illuminate the exact location 

15 in the field where the corner of the building is to be 
placed using the visible laser beam of the scanner as a 
marker. 

[0021] The operator can then begin to stake out par- 
ticular locations at the site where structural and other 
20 features from the architect's plans are to be positioned. 
Note that this scan and targeting procedure will elimi- 
nate having surveyors manually determine where a fea- 
ture should be placed from the plan and then manually 
measuring that information at the site. 
25 [0022] The targeting aspect of the laser can be used 
to trace out all key features from the plans on the actual 
site, both before and during construction. For example, 
the visible laser can be used to target locations such as 
beams, doors or windows. The location of bolt holes 
30 could be marked. 

[0023] In existing structures (or structures under con- 
struction) where a penetration in a wall or beam need to 
be made the following procedure can be used. Since the 
laser is controlled by scanning mirrors, it is not limited 
35 to illuminating single point. Rather, the laser can actually 
draw geometric shapes, such as lines, rectangles or cir- 
cles where doors or windows might need to be placed. 
[0024] In addition, an active or passive device can be 
used in conjunction with the laser system to identify 
40 points of interest that are located in open empty space. 
The active device would be carried by an operator who 
positions it in the path of the visible beam and walks with 
it along the beam until the exact range (i.e. the given 
point's position in space) is reached, at which time the 
45 device gives an audible or visual signal to the operator 
to stop and position a stake or a marker at that point in 
space. 

[0025] The passive device would be used in a similar 
manner, except that the notification of reaching the de- 
50 sired position is given by the system itself instead of the 
target. This is achieved, for example, by the passive tar- 
get continually reflecting the laser beam back, and such 
returns are compared by the system to the correct range 
and a signal is given when the returned range is equal 
55 to the correct range of the desired point. 

[0026] Once construction has begun, the system can 
be used to periodically rescan the site. As shown in step 
1 1 8 of FIG. 1 , the site is rescanned with the laser scan- 
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ner to obtain a number of rescan points that correspond 
to a number of the scan points and a number of the de- 
fined points. Then, in step 120, the rescan points are 
compared with the corresponding defined points. 
[0027] This information can then be used to monitor 
the progress of the construction by comparing the res- 
can with the design model to determine the quantity and 
percentage of the work completed. In addition, the quan- 
tities of objects placed since the beginning of construc- 
tion and/or since the last scan ca be calculated and re- 
ported. 

[0028] In addition and more importantly, the scanned 
data can be compared to the stored design plans to de- 
termine if there are any deviations. Equally importantly, 
parts mating can be performed to determine if fabricated 
parts (which are usually fabricated at remote locations) 
will fit their designed or constructed support and tie 
points when delivered to the site. 
[0029] This process is performed by comparing scans 
of such fabricated parts with the stored design of the 
supports/tie points or, if the supports/tie points are con- 
structed, compared with scans of such constructed 
items. FIG. 2 shows a flow chart 200 that illustrates an 
example of the operation of a laser scanner with con- 
structed parts in accordance with the present invention. 
[0030] As shown in step 210 of FIG. 2, a site is 
scanned with a laser scanner to obtain a number of scan 
points that define a first structure, the scan points, in 
turn, include a number of first mating points. In addition, 
at step 212, a second structure built to be mated to the 
first structure is scanned to obtain a number of second 
mating points. At step 214, the first mating points are 
then compared with the second mating points to deter- 
mine if the second structure can be mated to the first 
structure. 

[0031] It is known that construction errors alone typi- 
cally account for anywhere between 8% and 1 4% of total 
project costs. By frequently surveying the construction 
site and comparing it with the plans or constructed com- 
ponents, one can minimize errors throughout the con- 
struction process. It is to be noted that the system can 
utilize bar codes and other similar devices as well as 
"smart chips" placed on objects in a scan to identify the 
object and any special information related thereto. Once 
the facility is built, the Cyrax system can be used to cre- 
ate "as built" drawings. The "as built" drawings can be 
updated over time as various modifications to the facil- 
ity/equipment are being made. 

[0032] The system would also be quite helpful in re- 
models or revamps. For example, to the extent that work 
needs to be done on a certain feature such as a piping 

system in a refinery, the system can scan the desired 
area and model that piping system and objects in its sur- 
rounding area. 

[0033] The system can be used to model the piping 
and other pertinent objects in the area (such as pipe 
supports, vessels, etc.) to determine among other 
things, sizes, configuration, and locations. The design- 



er, armed with that information and information about 
the required modifications, can use the system to com- 
plete the design by adding to the model the additional 
piping, components, and structures required and re- 
5 moving any piping, components, etc., as required. In 
other forms of remodeling, a constructability analysis 
might need to be performed. 

[0034] For example, one might need to determine if a 
new piece of equipment can be moved into place 

10 through existing doors and hallways. FIG. 3 shows a 
flow chart 300 that illustrates an example of the opera- 
tion of a laser scanner for a constructability analysis in 
accordance with the present invention. 
[0035] As shown in step 310 of FIG. 3, a site is 

15 scanned with a laser scanner to obtain a number of scan 
points that define an opening in a structure. In addition, 
at step 312, an object to be placed within the structure 
is scanned to obtain a number of object points. At step 
31 4, the scan points are compared with the object points 

20 to determine if the object can be moved through the 
opening to be placed within the structure. Thus, by 3-D 
modeling the site and the new piece of equipment, one 
can virtually "walk" the new device through the structural 
barriers and determine if it fits. Similarly, if a part of a 

25 wall needs to be cut out and moved through existing 
doors, the device will allow the operator to visualize 
whether such a move was feasible. 
[0036] The functionality of the system also lends itself 
to machine control functions. Machines are often con- 

30 trolled by robotic vision systems. The advantage of the 
device relates to its 3-D capabilities, long range capa- 
bility, accuracy, detail, portability and software function- 
ality. For example, the system can be used to guide 
earth moving equipment such as a bulldozer or grader 

35 to perform its work much more efficiently than manual 
control by a human operator. The following examples of 
such utilization are given. 

[0037] FIG. 4 shows a flow chart 400 that illustrates 

an example of the operation of a laser scanner for con- 
40 trolling an earth mover in accordance with the present 
invention. As shown in step 41 0 of FIG. 4, a laser scan- 
ner, which has a position in a coordinate system, is po- 
sitioned on the tract of land to scan the tract of land. 
Next, at step 412, the tract of land is scanned with the 
45 laser scanner to define a plurality of first points on the 
natural surface of the tract of land. The first points have 
positions in the coordinate system and elevation meas- 
ures of the project. 

[0038] At step 41 4, a grading plan for the tract of land 
50 is generated by the design architect/engineer. The grad- 
ing plan defines a to-be-constructed surface that differs 
from the natural surface. In addition, a plurality of sec- 
ond points are defined on the to-be-constructed surface. 
The second points have positions in the coordinate sys- 
55 tem and elevation measures of the project. Further, the 
surface described by the second points has a corre- 
sponding surface described by the first points. 
[0039] At step 41 6, the elevation measures of specific 
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points on the surface described by tlie second points 
are compared witli the elevation measures of the corre- 
sponding points on the surface described by the first 
points to define cut points and fill points in the coordinate 
system. A cut point is defined when the elevation meas- 
ure of a second point is less than the elevation measure 
of the corresponding first point, while a fill point is de- 
fined when the elevation measure of a second point is 
greater than the elevation measure of the corresponding 
first point. 

[0040] Thus, the system is used to perform an initial 
scan of the existing terrain, the scanned cloud of points 
is compared to the final design which is stored in the 
system, and the exact depth of cut/fill are determined at 
very close Intervals throughout the terrain. At step 41 8, 
this information Is fed Into an earth moving equipment 
that has a device which allows It to determine Its location 
in space (in the coordinate system) at any given time 
(such as a GPS system). 

[0041] At step 420, the earth mover is operated to 
form the constructed surface by removing earth from the 
cut points and adding earth to the fill points in response 

to the information derived from the comparison. The 
earth mover can be operated as described in U.S. Pat- 
ent No. 5,631 ,658 which is hereby Incorporated by ref- 
erence. As a result, the combined information allows the 
equipment to be operated with little operator interven- 
tion. 

[0042] The system can also obtain its position by 
mounting the scanning system on the equipment. A 
scan of the original terrain is performed and cut/fill areas 
are determined as described above. In this case, the 
system, being mounted on the earth moving equipment, 
can scan control targets or monuments placed on the 
ground (with known locations relative to the scan of the 
original terrain as well as to the new design). This infor- 
mation allows the system to guide the equipment with- 
out the use of other location devices, to perform Its op- 
erations at the required locations and depth. 
[0043] The system can also be used in underground 
mining operations. The system, mounted on a mine drill- 
ing equipment can scan the area to be drilled. This 3-D 
scan information will give the system detailed knowl- 
edgeof the location of the equipment relative to the mine 
shaft/walls. This information coupled with information 
about the desired depth and extent of cut, allows the 
system to determine the required moves and guide the 
equipment to perform the task. After the task is done, 
the system can do a second scan from the new location 
and determine the amount of material excavated and 
create a 3-D map of the new excavated area. It is to be 
noted that the same functionality can be achieved with- 
out the system being mounted on the equipment, as 
long as it can be placed in a location where the equip- 
ment and the areas to be excavated are in Its field of 
view. 

[0044] The system can also be used to facilitate han- 
dling of materials over long ranges. FIG. 5 shows a flow 



chart 500 that illustrates an example of the operation of 
a laser scanner for facilitating material handling in ac- 
cordance with the present invention. As shown in step 
510 of FIG. 5, a site is scanned with the laser scanner 

5 to obtain a number of scan points. Next, as step 512, 
objects within the site are identified by comparing the 
scan points to predefined geometric objects. Following 
this, at step 514, when an object Is Identified, commands 
are issued based on the identification of the objects. 

10 [0045] This can be very important with moveable 
cranes used in the container industry. For example, by 
placing a device on the top of a moveable crane, the 
system can be used to scan the yard and image the var- 
ious containers in the yard. The system can be used to 

^5 identify the type of container which is to be moved. Once 
the type of container is Identified, the appropriate sling 
can then be selected for holding the container. Thereaf- 
ter, the system can be used to accurately position the 
grappling mechanisms to pick up and move the contain- 

20 ex. 

[0046] In a similar manner as described above, the 
system can be used to guide robots in manufacturing 
and fabrication operations such as welding, cutting, 
painting, bin picking, etc. In shipping and similar cases, 

25 it can be used for ship or vehicle docking operations. 
[0047] The system also has the ability to be operated 
remotely. This use can free engineering and other staff 
from time consuming travel by commanding the system 
to perform scans remotely via a network or modem con- 

30 nection. A technician is needed at the site to be scanned 
to position the system at the desired location. Once that 
is done, the remote operator can perform all the required 
functions remotely. In this mode, the system can be also 
used to scan radio active areas or areas that are envi- 

35 ronmentally contaminated. In addition, this remote ca- 
pability allows the system to be mounted on a remotely 
operated roving vehicle or robot. 
[0048] The system can also be used for replicating ex- 
isting parts of structures, plants, ships, etc., that need 

40 replacement either during maintenance operations or 
during revamp. FIG. 6 shows a flow chart 600 that Illus- 
trates an example of the operation of a laser scanner for 
replicating existing parts in accordance with the present 
invention. As shown in step 610 of FIG. 6, an object is 

45 scanned with the laser scanner to obtain a number of 
object points. Next, at step 612, a model of the object is 
created from the object points. The model, in turn, in- 
cludes reproduction information. In step 614, a repro- 
ducing machine is controlled in response to the repro- 

50 duction information to reproduce the object. 

[0049] For example, a custom bent pipe In a refinery 
or a ship needing replacement or duplication can be 
scanned. The system can produce rapidly an accurate 
model of the bent pipe and when connected to a com- 

55 puter controlled automated pipe bending (CNC) ma- 
chine, can transfer that information to allow the machine 
to replicate the bend using a straight pipe. The system 
can scan the bent pipe after the operation is performed 
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to determine its conformance to tine original. 
[0050] The device can also be used in conjunction 
with scanned and modeled "as built" structures to create 
repositories of information about the objects in the mod- 
el. FIG. 7 shows a flow chart 700 that illustrates an ex- 
ample of the operation of a laser scanner for creating 
repositories of information about various objects in ac- 
cordance with the present invention. As shown in step 
71 Oof FIG. 7, a structure is scanned with the laser scan- 
ner to obtain a number of scan points. At step 712, an 
as-built model is created from the scan points. The mod- 
el, in turn, has a number of objects. At step 714, data 
links are added to each object. The data links refer to 
externally available information available about the ob- 
jects, and any number of types of data can be linked. In 
step 716, a system user can view data from data links 
by opening a viewer appropriate for the type of data re- 
ferred to by that particular link. 

[0051] For example, the various objects in a model 
created from a scan can be tied to external database 
information which might give, for example, purchase in- 
formation such as the age of a valve, when it was in- 
stalled, the type of valve, the manufacturer, as well as 
other types of information. Another link to external infor- 
mation could provide access to the available inventory 
of replacement parts by accessing information in an ex- 
ternal database, or any other source of online informa- 
tion. Similarly, the inspection history or maintenance 
records could be linked into the object. By tying all this 
information together, plant managers can keep abreast 
of all the details of the plants, use the system for man- 
agement, inspection and maintenance planning, and for 
operator and other staff training. This is extremely im- 
portant where the workforce is transient. In this case, 
changes are often made over time to the structure and 
the people responsible for the changes are no longer 
available to question how those changes were made. In 
addition to the above-mentioned advantages, the sys- 
tem has the ability to allow more efficient management 
thus cutting operating costs. 

[0052] As mentioned earlier, the system can use bar 
codes or other similar passive or active devices at- 
tached to the objects being scanned to automatically ac- 
quire additional information about such objects such as 
model number, in service date, maintenance history, 
etc. 

[0053] In addition to the capabilities mentioned earli- 
er, the system, acting as a "3-D browser", can allow us- 
ers to view information contained in the data links stored 
within the object. The viewers are the appropriate pro- 
grams for the particular data link. For example, a link to 
a vendors web site would be viewed by launching a web 
browser. A link to a drawing file would be viewed by 
opening the appropriate drawing viewer. A link to an ex- 
ternal database would present the results directly in a 
window. Furthermore, the system is designed to include 
a server database which allows the model to be stored 
in a central location to be accessed by multiple users 



anywhere to work on the model, or use the model to ac- 
cess data or to launch other applications relating to the 
model or its objects. The system's database has locking 
and versioning capabilities to safeguard the integrity of 
5 the data while allowing multiple users to work on it si- 
multaneously. 

[0054] As noted in the above-identified PCT applica- 
tion, the system includes sophisticated software capa- 
ble of converting the 3-D cloud of points into CAD-type 

10 drawings. In operation, the cloud of points can be seg- 
mented into real world geometric figures. These geo- 
metric figures can then more easily be converted into 
CAD models. 

[0055] The 3-D point cloud can also be used directly 
15 to carry out a number of procedures without segmenta- 
tion into geometric shapes. In some cases, the direct 
use of the point cloud can be more advantageous. 
[0056] It should be noted that each point in the cloud 
has coordinates associated therewith. The distances 
20 between each point can be directly determined from the 
data. These relationships permit many of the proce- 
dures discussed above to be performed directly from the 
point cloud. For example, comparing the progress of 
construction from one day or another can be done in 
25 comparing one set of point clouds to another set of point 
clouds. The data in the point clouds is very dense and, 
therefore, can provide additional information. 
[0057] The system can generate contours and cross 
sections from the cloud of points in real time. It can also 
30 develop 2-D plan, elevations, and sections directly and 
in real time from the cloud of points. 
In addition to collecting geometric information about 
scanned surfaces, the system also collects surface in- 
tensity information. This information allows the cloud of 
35 points to be used to identify and map surfaces of differ- 
ing reflectance properties, such as rusting areas on ob- 
ject surfaces, and mineral areas on mine surfaces. This 
capability can also map sudden changes in surface nor- 
mals such as the two sides of a cracked surface, and 
40 can also identify blemishes (such as gouges) in materi- 
als. 

[0058] It should be understood that various alterna- 
tives to the embodiment of the invention described here- 
in may be employed in practicing the invention. Thus, it 
45 Is intended that the following claims define the scope of 
the invention and that methods and structures within the 
scope of these claims and their equivalents be covered 
thereby. 

50 

Claims 

1 . A method for operating a laser scanner, the method 
comprising the steps of: 

55 

scanning a site with the laser scanner to create 

a number of scan points; 

registering the scanned points with points in a 
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drawing of the site to form registered data; 
identifying a location of interest from tine regis- 
tered data; and 

illuminating a location at the site with a laser 
beam from the laser scanner that corresponds 5 
with the location of interest. 

2. The method of claim 1 wherein the location of inter- 
est is a location on the ground representing a fea- 
ture from a to-be-constructed building. io 

3. The method of claim 1 or 2 wherein the location of 
interest is identified by illuminating a device posi- 
tioned above the surface of the ground. 

15 

4. The method of claim 3 wherein the device reflects 
the laser beam back to the laser scanner, and 
wherein the laser scanner indicates direction to 
reach the location of interest. 

20 

5. The method of claim 1 and further comprising the 
steps of: 

rescanning the site with the laser scanner to ob- 
tain a number of rescan points, the rescan 25 
points corresponding to a number of the scan 
points and a number of the defined points; and 
comparing the rescan points with the corre- 
sponding defined points. 

30 

6. The method of claim 5 wherein the comparison in- 
dicates an amount of the defined points that are rep- 
resented by a physical structure. 

7. The method according to one of the preceding 35 
claims wherein the laser scanner is remotely oper- 
ated. 

8. The method according to one of the preceding 
claims wherein the drawing of the site is originally 40 
created by scanning the site with the laser scanner. 
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100. 

X ^110 



SCAN A SELECTED SITE WITH LASER SCANNER TO 
CREATE A FIELD SURVEY. 






PLAN STRUCTURE USING FIELD SURVEY CREATE 
DRAWINGS OF A STRUCTURE HAVING DEFINED POINTS 
THAT ARE POSITIONALLY RELATED TO SCAN POINTS IN 

THE FIELD SURVEY. DOWNLOAD DRAWINGS INTO 
USER SCANNER. 






RESCAN SITE TO OBTAIN RESCAN DATA THAT 
CORRESPONDS TO A NUMBER OF THE SCAN POINTS. 




^116 


REGISTER RESCAN DATAW 
DRAWING TO FORM 


TH DEFINED POINTS FROM 
REGISTERED DATA. 



118 



IDENTIFY LOCATIONS OF INTEREST FROM THE 
REGISTERED DATA. 



1 


^120 


ILLUMINATE THE LOCATION OF INTEREST ON THE 
GROUND AT THE SITE USING THE VISIBLE LASER BEAM. 



FIG. 1 
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200, 



210 



SCAN SITE WITH LASER SCANNER TO OBTAIN SCAN 
POINTS THAT INCLUDE A NUMBER OF FIRST MATING 
POINTS OF A FIRST STRUCTURE. 



212 



SCAN STRUCTURE BUILT TO BE MATED TO THE FIRST 
STRUCTURE TO OBTAIN A NUMBER OF SECOND 
MATING POINTS. 



214 



COMPARE FIRST MATING POINTS WITH SECOND 
MATING POINTS TO DETERMINE IF THE SECOND 
STRUCTURE CAN BE MATED TO THE FIRST STRUCTURE 



FIG. 2 



300^ 



^ ^310 

SCAN SITE WITH LASER SCANNER TO OBTAIN A 
NUMBER OF SCAN POINTS THAT DEFINE AN OPENING 
IN A STRUCTURE. 



^312 

1 ( 

SCAN AN OBJECT TO BE PLACED WITHIN A STRUCTURE 
TO OBTAIN A NUMBER OF OBJECT POINTS. 



314 



COMPARE SCAN POINTS WITH OBJECT POINTS TO 
DETERMINE IF OBJECT CAN BE MOVED THROUGH THE 
OPENING TO BE PLACED IN THE STRUCTURE 



FIG. 3 
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^410 



POSITION LASER SCANNER ON A TRACT OF LAND 
SCANNER HAS A POSITION WITHIN A COORDINATE 
SYSTEM. 



^412 



SCAN THE TRACT OF LAND WITH THE LASER SCANNER 
TO DEFINE FIRST POINTS ON THE NATURAL SURFACE 
OF THE LAND. THE FIRST POINTS HAVE POSITIONS IN 
THE COORDINATE SYSTEM AND ELEVATION 

MEASURES. 



^414 



GENERATE GRADING PLAN THAT DEFINES A 
TO-BE-CONSTRUCTED SURFACE THAT DIFFERS FROM 
THE NATURAL SURFACE. A PLURALITY OF SECOND 
POINTS ARE DEFINED ON THE TO-BE-CONSTRUCTED 
SURFACE THAT HAVE POSITIONS IN THE COORDINATE 

SYSTEM AND ELEVATION MEASURES. THE 
TO-BE-CONSTRUCTED SURFACE REPRESENTED BY THE 
SECOND POINTS HAS A CORRESPONDING SURFACE 
DESCRIBED BY THE FIRST POINTS 



^416 



COMPARE ELEVATION MEASURES OF SPECIFIC POINTS 
ON THE TO-BE-CONSTRUCTED SURFACE DESCRIBED BY 
THE SECOND POINTS WITH THE ELEVATION MEASURES 
OF THE POINTS ON THE CORRESPONDING SURFACE 
DESCRIBED BY THE FIRST POINTS TO DEFINE CUT 
POINTS AND FILL POINTS. 



^418 



FEED INFORMATION INTO EARTH MOVING EQUIPMENT 
THAT HAS A DEVICE WHICH ALLOWS IT TO DETERMINE 
ITS LOCATION. 



^420 



OPERATE EARTH MOVER TO FORM THE CONSTRUCTED 
SURFACE BY REMOVING EARTH FROM THE CUT POINTS 
AND ADDING EARTH TO THE FILL POINTS IN RESPONSE 
TO THE INFORMATION DERIVED FROM THE 
COMPARISON. 



FIG. 4 
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^510 

SCAN A SITE WITH A LASER SCANNER TO OBTAIN A 
NUMBER OF SCAN POINTS. 



^1 



512 



IDENTIFY OBJECTS WITHIN THE SITE BY COMPARING 
THE SCAN POINTS TO PREDEFINED GEOMETRIC 
OBJECTS. 



z: 



514 



ISSUE COMMANDS BASED ON THE IDENTIFICATION OF 
THE OBJECTS. 



FIG. 5 



600v 

^ ^610 

SCAN OBJECT WITH LASER SCANNER TO OBTAIN A 
NUMBER OF OBJECT POINTS. 



612 



CREATE A MODEL OF THE OBJECT FROM THE OBJECT 
POINTS. THE MODEL HAVING REPRODUCTION 
INFORMATION. 



614 



CONTROLLING A REPRODUCING MACHINE IN 
RESPONSE TO THE REPRODUCTION INFORMATION TO 
REPRODUCE THE OBJECT. 



FIG. 6 
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^710 



SCAN A STRUCTURE WITH A LASER SCANNER TO 
OBTAIN A NUMBER OF SCAN POINTS. 






CREATE AS-BUILT MODEL FROM SCAN POINTS. 




^714 


ADD DATA LINKS TO OBJECTS THAT REFER TO 
EXTERNAL OBJECT INFORMATION. 




^716 


WHEN QUERIED BY USER, OPEN APPROPRIATE VIEWER 
FOR A PARTICLAR DATA LINK. 



FIG. 7 



